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Any decomposition of the total trajectory entropy production for Markovian systems has a joint 
probability distribution satisfying a generalized detailed fluctuation theorem, when all the contribut- 
ing terms are odd with respect to time reversal. The expression of the result does not bring into play 
dual probability distributions, hence easing potential applications. We show that several fluctuation 
theorems for perturbed non-equilibrium steady states are unified and arise as particular cases of 
this general result. In particular, we show that the joint probability distribution of the system and 
reservoir trajectory entropies satisfy a detailed fluctuation theorem valid for all times although each 
contribution does not do it separately. 
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The non-equilibrium stochastic thermodynamics of 
small systems has attracted a lot of attention in the last 
years. From the experimental side the development of 
techniques for microscopic manipulation has allowed to 
study fluctuations in small systems of interest in Physics, 
Chemistry and Biology [1, 2]. From the theoretical side 
a group of exact relations known as fluctuation theorems 
(FT) [3-8] has shed light into the principles governing 
dissipation and fluctuations in non-equilibrium phenom- 
ena, as in driven systems in contact with thermal bath. 
Formally, the generality of the FTs can be attributed to 
the way probability distribution functions of different ob- 
servables behave under time-reversal symmetry-breaking 
perturbations (see [9, 10] for reviews on FT). 

Oono and Paniconi [11] proposed a phenomenological 
framework for a "non-equilibrium steady-state (NESS) 
thermodynamics" aimed at describing fluctuating sys- 
tems subjected to an external protocol. In this approach, 
the total exchanged heat during a time interval r by a 
system initially prepared in a NESS is expressed as the 
sum of two contributions, Q*"* = Q^^ + Q^. The "ex- 
cess heat" Q^^ is, in average, associated with the energy 
exchange during transitions between steady-states while 
the "housekeeping heat" Q^^ corresponds, in average, to 
the energy we need to supply to maintain the system 
in a NESS. Hatano and Sasa [12] introduced a formal 
framework for these phenomenological ideas and derived 
a FT which extends the second law of thermodynamics 
for transitions between NESS controlled by external pa- 
rameters cr(i). The Hatano and Sasa FT is applicable to 
trajectories x(t) evolved with a Langevin or more gener- 
ally a Markovian dynamics starting from an initial con- 
dition sampled from a NESS compatible with the initial 
values cr(0) of the control parameters. 

Under identical conditions different FTs were subse- 
quently proposed for NESS, involving the above decom- 
position of the exchanged heat. We can distinguish be- 
tween the so-called integral and detailed FTs for sys- 



tems initially prepared as described above. The inte- 
gral fluctuation theorems (IFT) are exact relations for 
the average over histories of different stochastic trajec- 
tory functionals VF[x], such as {e~^) = 1. Examples are 
the Jarzynski FT for the total work [7] , the Hatano-Sasa 
FT [12] and the Speck-Seifert FT [13]. The so called 
detailed FT (DFT) are, on the other hand, exact rela- 
tions for the probability distributions functions (PDF) of 
different observables W, such as P{W)/P^{-W) = e^ 
where P^{W) corresponds to the time-reversed protocol 
(T^'{t) = g(t — t), and a NESS initial condition compat- 
ible with ctIt). Examples are given by the Crooks rela- 
tion [8], or Seifert fluctuation theorem [14]. While ob- 
servables satisfying a DFT trivially satisfy an IFT, the 
opposite is not always true. In many recently formu- 
lated DFTs, a modified "dual" PDF pl^(PF) enters into 
play [15, 16], which corresponds to trajectories gener- 
ated by the adjoint dynamics (defined below) , in general 
different from the original dynamics of the system. The 
presence of dual distributions is a strong limitation to the 
experimental use of such DFT, or to theoretical applica- 
tions {e.g. obtaining NESS generalization of fluctuation- 
dissipation relations). A central result of our work is 
that generalized DFTs can be established without rely- 
ing on dual probabilities by considering joint probability 
distributions for different complementary observables, in- 
stead of single PDFs. The joint probability distributions 
arise naturally from the above mentioned separation of 
two contributions to the total heat exchanged in a NESS. 
From this novel joint DFT all the known DFT and IFT 
follow in a straightforward way. 

Among the fluctuation theorems formulated for 
Markov dynamics, the total trajectory entropy produc- 
tion 5[a;;o-] = ln('P[a;; CT]/7'[a;^; cr^]) plays a fundamen- 
tal role [5, 6, 14]. Here 7'[x;(7] (7'[a;^; cr^]) denotes the 
probability density of trajectory x (time reversed trajec- 
tory x^) in the forward (backward) protocol. We in- 
clude in V the initial distribution of x. We omit here- 



after the final time t in all trajectory functionals, and 
use calligraphic symbols to denote functionals, and nor- 
mal symbols to denote their values. It is straightfor- 
ward to show that the total trajectory entropy produc- 
tion is odd upon time-reversal: <S[x'^;(T^] = —S[x;(t]. 
We show that any decomposition of iS in M distinct con- 
tributions, 5[a:;cr] ~ J2i -4j[a;;cr], each of them being 
odd ^42^^;'''^] = —■Ai[x;(T], has a generating function 
satisfying the symmetry 



t'), modelling the interaction of the system with a ther- 
mal bath at temperature T. We consider for simplicity 
a single degree of freedom x, but our results are easily 
generalized e.g. in larger dimensions and/or with more 
particles. For a stochastic trajectory generated by (4) we 
define the total exchanged heat as [17] 

(3Q'°'[x;<j] = -/3 / dtx[d,U{x;a)-f] (5) 



,-j:r X^M[x;a] 



= -Ef (1-A,)^. 



(1) 



where Xi are arbitrary parameters and (...)r denotes av- 
erage over trajectories in the reversed protocol. This 
symmetry is equivalent to the following generalized DFT 
for the joint probability of the Ai[x; cr]'s: 



The total exchanged heat in a trajectory can be split as 
Qtot ^ ghk_^ gex [ii]_ Defining (j>{x;a) = -lnpss{x,a) 
from the steady-state probability density pss{x,a) at 
fixed values of a = (a, /) Hatano and Sasa [12] proposed 
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P^{-A,,~A2 



-Am) 



= e^ with S=y A, (2) 
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Note that the result involves no use of dual PDFs. To 
prove (1) we start by noting that the average of any ob- 
servable 0[x\ over trajectories satisfies the relation 



PQ'^'lx; a] = r dt x[d^(j>{x- a) - /? {d^U{x- a)-/)' 
Jo 

for the housekeeping heat and 

l3Q^'"[x;a] = - f dtxd^<j)[x;a) 
Jo 



(6) 



(7) 



for the the excess heat. The Hatano-Sasa functional [12] 
3^[a;; cr] is then defined as 



{0[x;a])^ f VxP[x^;a^]0[x;a]e~^^'''''^''^ /- 

J y[x-G]= dtGd^(j){x-G)^PQ^^[x-a]+^(j,{x-a) {S) 

/■_„__„_ .,r R, Jo 



VxV[x;(j^]0[x^-a]e-^^'="' 



(3) 



where we have used iS[x; cr] 
the change of variable x — 



^M 



-S[x^;f7^] together with 

■. Considering iS[a;; cr] = 

5^^'^ ^i[2^;^] the proof comes around (e"^* \iAi[x;ij]\^ _ 

Eq.(2) is proved in a similar way, or also follows from (1) 
since it is a symmetry for the generating function of the 
joint distribution P(j4i, ...,Am). 

Before considering their particular application for ex- 
plicit decompositions of S we note that the symme- 
tries (1) and (2) are valid for all times r for systems pre- 
pared in any initial condition. In particular, we see that 
the total trajectory entropy production FTs {e~^) = 1 
and P{S)/P^'{—S) = e^ hold without further assump- 
tion. 

We will consider two generic frameworks where our re- 
sult applies: systems described (i) by Langevin dynamics, 
and (ii) by a Markov dynamics on discrete configurations, 
exemplifying their parallel features. Let us first consider 
a particle driven out of equilibrium by a constant force 
/ in a potential [/, subjected to the Langevin dynamics 



where A(j){x; a) = (J){x{t); a{T)) — (/)(x(0); cr(0)) is a time 
boundary term. 

We now assume that the system is initially prepared in 
a NESS compatible with cr(0). With the previous defini- 
tions of Eqs.(5),(6),(7) and (8) it is known that the total 
trajectory entropy production S can be decomposed as 
the sum of two contributions, in two different ways [13] 



S^y + l5Q^'^^Ac^ + PQ^ 



(9) 



i = -a,t/(x;a(i))+/ + e 



(4) 



where ait) represents a set of control parameters, and 
i{t) the Langevin noise, {£,{t)) = 0, (C(i)^(^')) = 2r(5(t - 



Let us now show that similar decompositions also ex- 
ist for Markov dynamics: we consider discrete configu- 
rations {C} with transition rates W(C — > C'\a) between 
configurations. They depend on cr, an external control 
parameter which may vary in time. The probability den- 
sity at time t obeys the Markov dynamics dtP{C,t) = 
X;c'VF(C' -^ C;a{t))P{C',t) ^ r{C]a{t))P{C,t) where 
r{C; a) = J2c' ^(^ -^ C; a) is the escape rate from con- 
figuration C. An history of the system is described by 
the succession of configuration (Co , . . . , Ck ) visited by the 
system, Ck being visited between t^ and tfc+i- Starting 
from initial distribution Pi(C,cr), the probability of an 

history is r[C]a] = e" /f^ ''*''('^(*)^'"(*» Jlfcii W^(Cfc-i ^ 
Cfe,crtfc)-Pi(C(0),cr(0)) meaning that the mean value of 
an history-dependent observable O is given by (O) = 

Ek>o Ec„...cJo dtK... /o^ dt,0[C, a]V[C, a]. We ob- 
tain that the total trajectory entropy production 
S[C; a] = ln(7'[C; a]/r[C^-, a^]) has a first decomposition 



S = A(t) + (3Q^°^ with A(/> = log ^j^l^l'Z^^W and 



P.{C{r).a{r)) 



K 



PQ'-' -H'o^^^^^-^fi^ (10) 



fc=l 



W{Ck^Ck-uat,) 



Although there is no natural definition of /3 we keep the 
notation /?Q*°* to exemplify the parallel with Langevin 
dynamics. 

Turning to the second decomposition, let's now assume 
that the initial distribution is steady-state: P; = pss = 
e""^. One directly checks that the Hatano-Sasa functional 
3^[C, cr] — /g dt C7da(j) writes 

K 

y = [cp{C,a)\l-Y^[ct^{Ck.at,) - cj^iCk-uat,)] (11) 
fe=i 



Besides, defining the house-keeping work as 

W(Cfc-i^Cfc,atJ 
W[Ck^Ck-i,at,) 



K 



JQh'^[C, a] =^ log 



k=l 
K 

E 



+ y6{Ck,cjt,)-c^{Ck-i,<yt,) (12) 



we check that the decomposition S = y+/3Q^^ holds [18]. 
The parallel between Markov and Langevin frameworks 
also appears by specializing to rates W{k -^ k ± 1) = 
g- 2-(^fc±i-^fc) of jumping on a Id lattice from site k to 
A: ± 1 in a tilted potential Vfc = C/fc — kf: in the continuum 
limit, one recovers the Langevin observables [18]. 

In the first decomposition, y can be identified with 
the so-called non-adiabatic contribution (since it van- 
ishes for quasistatic protocols) to the trajectory entropy 
Sna = y while PQ^^ (which is continuously produced in 
the steady-state) can be identified with the so-called adi- 
abatic part 5a = PQ^^ [16]. On the other hand, in the 
second decomposition of 5, A0 can be identified with the 
system contribution Sg = Acj) while /3Q*°* can be iden- 
tified with the reservoir contribution Sr = /3Q*°* to the 
total trajectory entropy production. 

The entropy decompositions of (9) satisfy the condi- 
tions for the application of the identities (1) or (2) since 
each term is odd with respect to time reversal in both 
decompositions. We can thus write DFTs (valid for all 
times t) for the joint probabilities as 



PiY,f3Q^ 



p(A0,/3g*°*) 



,y+/3Q" 



^ gA0+,3Q*°' 



PR(-A0, -PQ 
with (14) valid for any initial distribution with Acj) 



(13) 
(14) 



^°S pTcTrrCTTrlT while (13) requires starting from the 
NESS. The corresponding IFTs write 



-AA0-K/3Q"S 



-(1-A)J'r-(1-k)/3Q5; 



)r (15) 



Here Ar denotes here A'[a;;(T^], X representing y, Q**, 
Qtot Qj. ^0^ From (13) and (14) we have, in terms of 5*^, 
Sr. Sa and 5„a, that P(5„ 5,)/P«(-^,„ -5,) = e'S=+5- 

and PiSa,Sna)/P'^{-Sa,-Sna) = 6^" + ^-. It is WOrth 

noting that these relations do not involve dual PDFs, and 
thus they can be tested for a physical system with a given 
dynamics. We also note that while one can show that 5*0 
and Sna satisfy each one separately a DFT by using dual 
PDFs [16], S, and Sr satisfy a joint DFT although they 
do not satisfy separately a DFT. 

Let us now derive from an unified view the known FTs. 
As an intermediate step, it is useful to define a "dual" 
trajectory weight V^[x] as [15, 16] 



V'[x; a] — V[x; a]e 



-l3Q'^[xM 



(17) 



For Markov dynamics the dual probability P^ corre- 
sponds to the dynamics in the so-called dual rates 
iyt(c -> C',a) = e-['^(c'.'^)-'#'(c,<T)]vt^(c' ^ C,a) which 
share the same steady state as the original dynamics. In 
the case of the Langevin dynamics of Eq. (4). it corre- 
sponds to trajectories generated by the equation x = 
~d,W{x- a{t)) + /t + e with C/t = 2ct)/(3 ^U,p = -f. 
This equation also has the same steady state as the orig- 
inal one. In both cases, let us stress that the dual dy- 
namics corresponds to trajectories in a difi^erent physical 
system. We now follow (17) to write the dual joint PDF 
related to (13) as 



pt(y,/3g'^'^) = p(y,-/3Q''^)e 



/SQ" 



(18) 



which is normalized. Integrating this relation over Y, we 
first obtain the DFT [16] PWQ^^) == e^^"' P^~ I3Q^^) , 
and hence the IFT (e^^'^ ) — 1 [13]. Using now succes- 
sively (13) and (18) 



P{Y) 



diPQ^'') e^"^ P"(-r, -PQ^'') 



e^ /d(/3Q'''^)P^«(-y,/3Q'''^) 



(19) 



we see that the DFT P{Y) = e^Pt«(-y) [15] holds. 
This implies the corresponding IFT {e~-^) ~ 1 [12] (also 
derived from setting A = l,K = 0in(15) and using the 
Spcck-Scifert IFT). 

As an illustration of our approach, let us show how 
joint FTs provide insights on the experimental error in 
the evaluation of entropy productions. Consider an ex- 
periment where the steady state can be evaluated for 
different values of the control parameter a, e.g. micro- 
spheres optically driven in a liquid [19]. Having in hand 



— an experimental evaluation 



of (h, we write 



s = y 



cxp 



5y + /3Q^ 



(20) 



where ycxp[x;a] = J^ dtcrda(t)cxp and Sy = y - ^cxp is 
the difference between exact and experimental Hatano- 
Sasa functionals. Starting from the NESS associated to 



(t(0), each of the terms in (20) is odd upon time-reversal, 
and we can use Eq. (2) for Ad = 3, which yields the DFT 



hkN,^ Yexp+<5y+;3Q'' 



Using (18), this gives P{Y^^^,5Y) 

PtR(-rcxp, ~5Y)e^-^^+^^ and hence also the IFT 



(21) 



which allows to estimate the difference between the IFT 
(e"-*^) ~ 1 and the experimentally obtained (e~-^'=''p). 

As a second example let us consider the situation in 
which the system, initially prepared in a NESS, has a 
variation of its parameters Oiit) = a'^ -\- 5ai[t) in such a 
way that |^^| < 1, with cr° = ai{0) and 5(7,{Q) = 0. In 
this context a modified Fluctuation-Dissipation Theorem 
has been recently derived in Ref. [20] which relates dis- 
sipation under small perturbations around a NESS, with 
fluctuations in the corresponding steady state. One can 
expand the exponentials in (15) up to second order in Sa 
and then in powers of A and k. To second order in A and 
order zero in k, we arrive to (see [18] for details), 

(S,,(0,r))o = (%(r,0)e-^/o^'^**(*)-4-(t);'x"))^^ (22) 

where B.,{t,t') = O0(^);^°) 00(^0;^°) ^^^ v, = 

P'^dxCJ)— {dxU — f) corresponds to the average velocity in 
the NESS associated to a. For systems with Boltzmann- 
Gibbs steady state, the obtained result reduces to the 
symmetry Cijir) = Cij{-T), with Cij[T) = (6^(0, t))o. 
Eq.(22) can also be derived from Eq.(19) in Ref.[15]. 
However, the use of the joint PDF can lead us to ob- 
tain further new results. Let us introduce a weighted 
correlation function as 



Q(^,0) 



(g,j-(0,T)e-4Jo^'^*^W"^(^(«);^°))o 



(23) 



This correlation function carries explicit information 
about the lack of detailed balance and reduces to the 
usual one when the system is able to equilibrate. Using 
Eq.(15) with K=\ and repeating the same procedure we 
have done in order to obtain Eq.(22) we arrive to the re- 
sult C^{t, 0) = Cjj' {0, r), which is completely symmetric 
and reduces to the known result for equilibrium dynamics 
when detailed balance holds. 

In conclusion, the identities (1) and (2) and their 
immediate consequences for Markovian systems are the 
main message of this work. Equations (1) or (2) indeed 
contain, as particular cases, several known FTs such as 
the ones previously derived by Hatano and Sasa [12], 
Speck and Seifert [13], Chernyak et al. [15] and Esposito 
and Van den Broek [16]. In addition, an exact DFT, valid 
for all times t, holds for the joint distribution of the reser- 
voir and system entropy contributions to the total trajec- 
tory entropy production, although each contribution docs 



not do it separately, as given by Eq.(14). Also a similar 
DFT holds for the joint distribution of the adiabatic and 
nonadiabatic entropy contributions to the total trajec- 
tory entropy, as given by Eq.(13). It is worth to mention 
that for the type of NESS discussed here, M = 2 de- 
compositions of the total trajectory entropy production 
are obtained, Eq.(9), and thus two- variable joint PDFs 
are all that is needed for the corresponding DFTs. We 
have shown and example with M = 3 for handling ex- 
perimental errors in the Hatano-Sasa FT. In any case, in 
the light of (1) and (2), obtaining an adequate minimal 
M-decomposition of the total trajectory entropy produc- 
tion constitutes the cornerstone towards the derivation 
of generalized FTs for non-equilibrium systems. 
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